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Abstract 

In this paper we investigate a sequence of square integrable random processes with space varying memory. 

We establish sufficient conditions for the central limit theorem in the space L^{yi) for the partial sums of 
the sequence of random processes with space varying long memory. Of particular interest is a non-standard 
normalization of the partial sums in the central limit theorem. 
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1 Introduction 

Memory of a second-order stationary sequence of random variables {W} is usually defined in terms of the 
decay of autocovariances Cov [Vq, IJ,]. For example, {Yk} is said to have long memory if the series 

OO 

^|Cov[Fo,vqi 

^—0 

diverges, while short memory of {Yk} corresponds to the convergence of the series above. For a review of the 
notion of long memory, we refer to Samorodnitsky [11]; for probabilistic foundations, statistical methods, and 
applications, we refer to Giraitis, Koul, and Surgailis [4], and Beran [1]. 

Interesting and important features of memory are reflected in the growth rate of the partial sums W. 

The partial sums W of a short memory sequence of random variables appear to grow at the rate of 

the central limit theorem whereas the partial sums of a long memory sequence of random variables may 
grow faster. For example, if Cov [lb, Y/j] ^ h~‘^, 0 < d < 1, then the partial sums XTi grow at the rate 
of 

Memory of a sequence of multidimensional random elements may vary in space. That is, it can depend 
on the direction the sequence is projected. Memory of a second-order stationary sequence of Hilbert space 
valued random elements {Yk} can be associated with the regular decay of the autocovariance operators 
Qh '■= Cov[lbjV/i] by assuming, for instance, Qh h~^Q, where D and Q are certain operators on the 
Hilbert space (see Rackauskas and Suquet [10] for further details). The corresponding sequence has space 
varying memory which depends on the operator D. 

We investigate a sequence of random processes {Xk} '■= {Xk{t),t € S} which is defined for each k G Z and 
each t G S' by 

OO 

Xk{t) ■■= X U + 

3=0 

* Corresponding author. 
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where S is some index set, {sk(t)} is a sequence of independent and identically distributed random variables 
and d(t) is a real function of t. 

The sequence {Xfc(t)} for each t G S is essentially similar to the fractional ARIMA(0,1 — d{t),0) process, 
which may be expressed as an MA(oo) process with the coefficients 


r (j + 1 - d{t)) 

r(j + i)r(i-d(<))’ ^ 


0 , 1 , 2 ..., 


where r(-) is the gamma function (the fractional ARIMA process was introduced by Granger and Joyeux [5] 
and Hosking [7]). The application of Stirling’s formula to the coefficients above yields the following relation: 


r (j + 1 - d{t)) 

r{j + i)T{i-d{t)) ^ r{i -d{t)) 


The growth rate of the partial sums J2k=i ^k{t) depends on t. Interpreting fc G Z as a time index and t G S 
as a space index we thus have a sequence of real valued random processes {X^} = {Xk(t),t £5} with space 
varying memory. Such sequences of random processes could serve as a model in functional data analysis (we 
refer to Ramsay and Silverman [9] for an introduction to functional data analysis, for the theory of linear 
processes in function spaces, see Bosq [2]). 

We investigate the growth of the partial sums in the sample path space of square integrable real 

valued functions and establish sufficient conditions for the central limit theorem for the partial sums X]fc=i 

Figure 1 shows simulated sample paths of the random processes of the sequence {Xk}. The sequence {efe} := 
{efe(t) :tG [0,1]} was assumed to be a sequence of independent and identically distributed standard Wiener 
processes on the interval [0,1] and the function d : [0,1] —>■ (1/2,+oo) was assumed to be a step function 
d{t) = diX[o,i/ 2 )(t) + rf 2 X[i/ 2 ,i] (i)j where XA is the indicator function of A. The simulated sample paths for 5 
consecutive elements of the sequence {Xk} were plotted. The procedure was completed for two different sets 
of the values of di and d 2 (di = 0.6, d 2 = 2 and di = 0.6, d 2 = 0.7). 


di=0.6, cl2=2 


di=0.6, d2=0.7 



t 



t 


Figure 1: Simulated sample paths of the random processes of the sequence {Xk} (horizontal axis is the index 
set [0,1] of the random processes {Xk}, vertical axis is the value of the random process Xkit) at a point 
t G [0, 1]) 
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The rest of the paper is organized as follows. The sequence of random processes {Xk} is defined and investi¬ 
gated in Section 2. In Section 3 we establish sufficient conditions for the central limit theorem for the partial 
sums J2l^iXk. 


2 Some preliminaries 

Let (S', S, fj,) be a a-finite measure space. Consider a sequence of independent and identically distributed 
measurable random processes {sk} ■= {£k{t) '■ t £ S} defined on the same probability space (fl, P) with 
Eefc(t) = 0 and EeKt) < oo for each t £ S and each k £ Z. Let us denote := Eeg(t) and <j{s,t) := 
E [eo(s)eo(t)], where s,t £ S. 

We define a sequence of random processes {Xk} '■= {Xk{t),t G S} by setting for each t £ S and each fc G Z 

OO 

Xk{t)-.= Y,{j + ir‘''''^ek-,{t), (1) 

i=o 

where d{t) >1/2 for each t £ S. d{t) > 1/2 is a necessary and sufficient condition for the almost sure 
convergence of the series (1). This fact easily follows from Kolmogorov’s three-series theorem. 

It is possible to choose some other second-order stationary sequence of random variables that can have long 
memory (for example, Yk{t) = ^^Qaj{t)ek-jit), where aj{t) ~ (j -I- but our aim is to investigate 

space varying memory and we want to avoid any unnecessary technical difficulties. 

If Eeo(i) 0, then the sequence {Xfc(t)}, t £ S, can only have short memory (i.e. absolutely summable auto¬ 
covariances), since then the series (1) converges almost surely if and only if d{t) > 1 and absolute summability 
of (j + 1)“"^^*^ implies that autocovariances are absolutely summable (see, for example, Hamilton [6], p. 70). 

Routine calculations show that the sequences {Xfc(s)} and {Xk{t)} for s,t £ S are sequences of zero mean 
random variables with the following expression for the cross-covariance 

OO 

E [Xo{s)Xk{t)] = a{s, t) ^ (j + (j + h + !)-''(*) . (2) 

j=0 

Now we establish the asymptotic behaviour of the sequence of cross-covariances. a„ ~ as n —>■ oo indicates 
that the sequences a„ and b„ are asymptotically equivalent, i.e. the ratio of the two sequences tends to one 
as n goes to infinity. 

Proposition 1. Let s,t £ S be fixed. < d{s) < 1 and d{t) > 1/2, then 

E [Xo(s)X?i(t)] ~ c(s, <)ct(s, t) • as h —>• oo, 

where 

pOO 

c{s,t):= + (3) 

Jo 

If s = t, we denote c{t) := c(t,t) and cr^(t) := a{t,t). 

If d{s) = d{t) = 1, then 

E[Xo{s)Xh{t)] ^ a{s,t) ■ h~^ \nh as h —>• oo. 

Proof. We approximate the series in equation (2) by integrals to obtain the following inequalities: if ^ < 
d{s) < I and d{t) > i, then we obtain 

OQ poo 

+ + + dx, (4) 

QQ poo 

(j -p I)-'^(®) U + h + 1)”'^^*^ < h^-Ws)+d(t)] / 

-^0 
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if d{s) = d{t) = 1, then we have that 


^[{j + l)ij + h+l)]-^>h- 


j=o 


In 


h+1 


^ [(j + l)(j + ^ + 1)] <(^ + 1) +h 

3=0 


-1 


/ OO 

[2/(y + l)]"^dj/ 

/ OO 

[y{y + ^)r^ dy 


h + 1 


Next, we investigate the convergence of the series of cross-covariances. 
Proposition 2. Let s,t G S. The series 


^E[Xo(s)X;,(t)] 


h=l 


converges if and only if both of the conditions d{t) > 1 and d{s) + d{t) > 2 are fulfilled. 
Proof. Series (5) has the following expression 


□ 


(5) 


^E[Xo(s)X,(t)] 

h^l 


a{s,t) 


^(h + i) ^ ^ (j + 1) ‘^^"^(j + h + 1) 

h=l h=l j=l 


The hrst series of the right-hand side of the equation above converges if and only if d{t) > 1. Thus, we only 
need to investigate the convergence of the series 


5]5](j + i) ‘'^"^(j + h + 1) ‘'d), 

h=l i=l 


( 6 ) 


A slight modification of inequality (4) shows that series (6) diverges if d{s) + d{t) < 2. To show that series (6) 
converges if d{t) > 1 and d{s) -I- d{t) > 2, we choose d > 0 such that 1 < 1 -I- d < d{t) and d{s) -I- d{t) — S > 2 
to obtain the following inequality 

OO OO OO OO 

^ ^ (j + ij + h+ ^ ^ (j -f i)-A«)-rf(‘)+i+'5 /i-(l+-5) < OO. □ 

h=l j=l h=l j=l 


Remark 1. The series ^ [Xo{t)Xh{t)] converges if and only if d{t) > 1. 

Suppose (fj.) := C? (S', S, /r) is a separable space of real valued square /i-integrable functions with a seminorm 

|/(r)|2 ^(dr) 


Proposition 3 establishes assumptions under which the sample paths of the processes {X^} almost surely 
belong to the space £2 

Proposition 3. The sample paths of the random processes {Xff\ almost surely belong to the space C? (p.) if 
and only if both of the integrals 



and 


Is2d{r) - 1 


fj,{dr) 


(7) 


are finite. 
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Proof. We show that the expected value 


E 


^0 (dr) 


L-'S 


is finite if and only if integrals (7) are finite. First, using Fubini’s theorem we obtain 


E 


^0 (dr) 


= / EX^(r)/r(dr). 

Js 


Secondly, setting h = 0 and s = t in equation (2) gives the expression for the variance 

OO 

+ t&S. 

3=0 

Approximation of the series above by integrals leads to the following inequalities 


2^EA2(r)/x(dr) > ^cr^(r) ^ (dr) + ^ j(r) - 1 ^ ’ 

jEX^{r) ^iidr) < /x (dr) + 2d{r)- 1 ^ ’ 


□ 


3 The central limit theorem 


Before we formulate sufficient conditions for the central limit theorem, we clarify what is meant by weak 
convergence of a sequence of random processes with square /i-integrable sample paths (see Cremers and 
Kadelka [3] for details). Suppose {^„} is a sequence of measurable random processes with sample paths 
in (ii). Let (/r) := {S,S,fi) be the corresponding Banach space of equivalence classes of ^-almost 
everywhere equal measurable functions and let B (/i)) be its Borel cr-algebra. The maps —>■ 

Lf {p) —>■ Cn(‘^) •= are J" — (L^ (/r))-measurable (see Cremers and Kadelka [3]); hence the 

distributions Pn of are well defined probability measures on (L^ (/r), (L^ (/r))). It is said that the 

sequence {■Jn} converges weakly to f and it is written ■C" E the corresponding image measures P„ 

converge weakly, i.e. / /dP„ —>■ / fdP for all continuous and bounded real valued functions defined on (^). 


The following result establishes sufficient conditions for the central limit theorem for the partial sums 
Proposition 4. (i) Suppose 1/2 < d{t) < 1, EeQ(t) < oo for each t £ S and both of the integrals 


-(r) 


Is [1 - d{r)]' 


■ pL (dr) and 


a^{r) 


ls[l-d{r)] [2d(r)-l] 


p.{dr) 


( 8 ) 


are finite. Then 

n 

n~^ ^ Xk ^ G, 

k=l 

where n~^ is a sequence of multiplication operators with the expression n~^f(t) = 

for each t £ S, f £ L'^ (/i), and G ■= {G{t),t £ S} is a zero mean Gaussian random process with the 

following autocovariance function 


E[G{s)Git)] 


[c(s,t) + c{t,s)]a{s,t) 
(2-[d{s) + d{t)]){d-[dis) + dit)]y 


where c(s,t) is the function (3) and cr{s,t) '■= E [eo(s)eo(i)], s,t£S. 
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(ii) Suppose d{t) = 1 and EeQ(t) < oo for each t € S and 


/ cr^(r) fj, (dr) < oo. 

Js 


Then 


1 

^/ri\nn 


Xk ^ G', 

k=l 


where Q' := {G'it),t € S} is a zero mean Gaussian random process with the autocovariance function 
E [^'(s)C/'(i)] = (t(s, t), where a{s, t) := E [eo(s)eo(t)], s, i G S'. 

Remark 2. If the essential infimum of d (t) is greater than 1, that is, if 


sup {cc G R : /r ({t : d (t) < a;}) = 0} > 1, 


then we can use Theorem 1 of Rackauskas and Suquet [8] to show that the central limit theorem holds for 
the partial sums of a similar second-order stationary sequence of (/i)-valued random elements. Suppose 
that {V'fc} is a sequence of independent and identically distributed random elements of (/x). Let us define 
a sequence of (/x)-valued random elements by setting for each k £ Z 

OO 

Yk ■= 'y ] Ajipk-j ; (9) 

j=o 

where Aj is a sequence of multiplication operators with the following expression 

Ajipk-j (t) = {j + tpk-jit) 

for each t £ S. The sequence (9) is essentially similar to the sequence {Xk} of random processes (1). According 
to Theorem 1 of Rackauskas and Suquet [8], Y^'k=i Yk converges in distribution to a Gaussian random 

element of (/x) if n~^/‘^Yl'k=i V'fe converges in distribution to a Gaussian random element of (/x) (see 
Rackauskas and Suquet [8] for more details). 


Proof of Proposition 4- The proof is based on a part of Theorem 2 of Gremers and Kadelka [3]. We provide 
the proof in several steps. To establish that the sequence {^„} weakly converges to we need to show that 
the following is true: 

(a) for each t £ S Yf^{t) -£ E^^(f) as n —>■ oo; 

(b) the finite-dimensional distributions of converge weakly to those of the f almost everywhere; 

(c) for each t £ S and n £ N Eff{t) < f{t), where / is a non-negative /x-integrable function. 

We begin by proving part (a). We show that for each t £ S the sequences E 
E [(ynlnn)"^ ^k=i Xk{t)]'^ converge to EC/^(t) and EC/'^(f) respectively. 

The growth rate of the cross-covariance of the partial sums of the sequences {Xfc(s)} and {Xk{t)} ,s,t£ S, 
is established in Proposition 5. 

Proposition 5. If 1/2 < d{s) < 1 and 1/2 < d{t) < 1, then 


E 




where c{s,t) is function (3). 
If d{s) = 1 and d{t) = 1, then 


[c{s,t)+c{t,s)]a{s,t) 3_id{s)+d{t)] 

{2-[d{s)+dm{3-[d{s) + dm' 


as n —>■ oo, 


E 




L \fc=l 
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a{s, t) ■ n In^ n. 



Proof. The cross-covariance of the partial sums of the sequences {Xfc(s)} and {Xk{t)} has the following 
expression 


E 


E Xkit) 


\k^l 


\k^l 


= nE[Xois)Xoit)] 

^ _X 71 / 

+ E E E [Xk{s)Xi{t)] + E E E [Xk{t)Xi{s)]. (10) 


k—1 l—k-\-l 


k—1 l—k-\-l 


Since 


E E E [Xkis)Xiit)] = n E E [Xo(s)Xfc(t)] - E ^ E [Xo(s)Xfc(t)] 

k—1 l—k-\-l 






we can use the results of Proposition 1 to obtain the following asymptotic relations: if 1/2 < d{s) < 1 and 
1/2 < d(t) < 1, then 




n—1 






if d{s) = 1 and d{t) = 1, then 


EE[Xo(s)Xfc(t)]~^M.ln2n, 

k E [Xo(s)Xfc(t)] ~ a{s, t) • n Inn. 


n—1 


□ 


fc=i 


Remark 3. The growth rate of the variance of the partial sums of the sequence {Xk{t)} is the following: if 
1/2 < d{t) < 1, then 


if d{t) = 1, then 


E 




.fc=i 




[1 — d{t)] [3 — 2d{t)] 


. „3-2d(t). 


E 




.k=l 


cr^(f) • nXr? n. 


Remark 3 completes the proof of part (a). 

Now we move on to the proof of part (b) and show that the finite dimensional distributions of n~^ X]fc=i 
and (v^lnn)”^ X]fe=i ^k converge to those of Q and Q' respectively. In order to prove the convergence of 
finite dimensional distributions we investigate a sequence of random vectors 


{b-\h)YZ=rXk{h) ... h-\t,)Yrk=iMk)), 


( 11 ) 


where ti,... ,tq € S and 


bnit) ■■= 


\zl2-d(t)^ l/2<d(t)<l; 

Y^lnn, d{t) = 1. 
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The sum of dependent random variables can be expressed as a series of independent random 

variables: if n > 2, then we have the following identity 


fc=i 


where 

By denoting 
and 


■ — 


j=-oo 

2<j<n; 


ELi (fc-j + 1) 


-d(t) 


J<2. 




Bn,j diag ( (tl)z„j(tl) ... {tq)Znjitq) ) 

we can express the sequence of random vectors (11) compactly as 

E"=-oo [KHtl)Zn,j{ti)] 


E Bn,. 


Jq) _ 


j = -oo 


'^j=-oc, [^n^i'^q)Zn,jitq) £j{tq) 


Using the fact that the operator norm of a diagonal matrix is the largest entry in absolute value, we obtain 
the operator norm of the matrix Bn,j 




Now suppose that 

■= { Ijitl) ■■■ Ijitq) V 

is a zero mean normal random vector with the same covariance matrix as the vector The sequence 

^j=-Qo converges in distribntion to a normal random vector if and only if the sequence of covariance 

matrices converges. Clearly, it follows from the results of Proposition 5, that the sequence of covariance 
matrices converges. 

To prove that the finite dimensional distributions converge weakly, we apply Proposition 4.1 of Rackauskas and 
Suquet [10], which establishes that under certain conditions the sequences J2j=-oc and J2j=-oc 

have the same limiting behaviour in the sense that if one converges in distribntion then so does the other and 
their limits coincide. 

We consider for g-dimensional random vectors U and V the distance 


C 3 (C/,U) := sup |E/([/)-E/(U)|, 

where T 3 is the set of three times Frechet differentiable functions / : R"? —>■ R such that 


sup 

seR’ 




< 1 , 


for j = 0,..., 3. 


For the sake of convenience, we state Proposition 4.1 of Rackauskas and Suquet [10] here. 

Proposition 6. If the following two conditions 

lim sup||U„j||^ = 0 (12) 


and 


lim sup < 00 . 


(13) 




are satisfied, then 


E J 2 Bn,nr] =0- 

\j=-oo i=-oo j 

Propositon 7 establishes that the sequence of operator norms of the matrices Bn,j satishes two properties that 
are needed to apply Proposition 6. 

Proposition 7. If ^ < d{t) < 1 for each t G S, then both of conditions (12) and (13) are satisfied. 

Proof. To prove that condition (12) holds, we hrst notice that 

sup II11^ = ni^ \bj, {ti)zn,i{ti)\ 
jez i<*<9 

and then we use the following asymptotic relations: if | < d{t) < 1, then we have that 

n 

if d{t) = 1, then we obtain 


fc=i 


1 — d{t) ’ 


k ^ ~ Inn. 


fe=i 


We use the following expression to prove that condition (13) holds 


E 4^ w = E 

i=2 


j=-oo 


r"-i+i 1 

2 r 

OO 

1 

Wi 
_1 

+ E 

1=0 L 


E 


-d{t) 


.k=l 


Routine approximations of sums by integrals from above lead to the following inequalities: if ^ < d{t) < 1, 
then we have that 


E 

1=2 

if d{t) = 1, then we obtain 


■"-1+1 

. fe=i 


< 


[1 - d{t)Y [3 - 2d{t)] L 




E 

1=2 


■"-1 + 1 

E 


< (n — 1) + n In^ n. 


To prove that 


1 


n—>-oo 77,3 2d{t) 


E 

1=0 




-d(t) 


.k=l 


< OO 


for I < d{t) < 1, we hrst divide the series in the expression above into two summands 


E 

1=0 


E 


-d{t) 


.k^l 


E^ 


-d{t) 


+E 

1=1 


E 


-dit) 


.fc=l 


( 14 ) 


and approximate the hrst summand on the right-hand side of the equation (14) by integral from above 

n ( 


1-1-Inn if d(t) = 1. 


k=l 
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We express the second summand on the right-hand side of equation (14) in the following way 


■E 


j=i Lfc=i 


J 2 ^k + jy 


■d(t) 


i—1 — 


-Ef- + - 

n \ n n 


-d{ty 


and the interchange of limits leads to the result 


jiT-n - 

n—¥oo 77,3—2d(t) Z 

j=l Lfe=i 


E 


J 2 {k+jy 


■d{t) 


7*00 r /*i “I ^ 

/ / (s + w)-^(‘)ds 

Jo Jo 


du < CO. 


□ 


The proof of part (b) is complete. 

Finally, we prove part (c). Proposition 8 establishes the existence of non-negative /r-integrable functions that 
dominate the sequence of the variance of the partial sums. 

Proposition 8. Let t £ S. If \ < d{t) < 1, then 

1 


E 


„3/2-d(i) 






< CT (t) 


1-b 


cr^{t)c{t) 


2d{t)-l\ [l-d{t)][3-2d{t)Y 


(15) 


where c{t) is the function (3). If d{f) = 1 for each t £ S, then 

^ n 2 


E 


1 


y/nhin 






<C-a‘^{t), 


(16) 


where C is a positive constant. 


Proof. To establish the first inequality in Proposition 8, we set s = t in expression (10) and approximate the 
sums in expression (10) by integrals from above. 

The following reasoning leads to inequality (16). We set s = t in expression (10) to obtain an expression for 
the left-hand side of inequality (16). Since d{t) = 1 for each < G S', by setting s = t in expression (2), we see 
that the only term in the expression of the left-hand side of inequality (16) that depends on t is cr^(t). It 
follows that the sequence 


1 


ajt) 


E 


1 


y/ninn 




k=l 


is a convergent sequence (see Remark 3) which does not depend on t. So it is bounded by some positive 
constant, say C. □ 

Remark 4. We can easily obtain the following upper bound for the function c{t), 

1 1 


~ 1 - d{t) ' 2 d{t) - 1’ 
and then we have the following inequality 

cr 2 (t)c(t) ^ 0-2 (t) 


t £ S, 


< 


ajt) 


[1 - d{t)] [3 - 2d{t)] " [1 - d{t)Y [1 - d{t)] [2dit) - 1] ■ 

If integrals (8) are finite, then the right-hand side of the inequality (15) is a /r-integrable function. 
Remark 4 completes the proof of part (c). The proof of Proposition 4 is complete. 


□ 
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